Generalization of State-observation-d Markov Mode
نویسنده
چکیده
Generalized Partly Hidden Markov Model (GPHMM) is proposed by modifying Partly Hidden Markov Model (PHMM), and it is successfully applied to the speech recognition. PHMM, which was proposed in our previous paper, is the novel stochastic model, in which the pairs of the hidden states (H-state) and the observable states (O-state) determine the stochastic phenomena of the current observation and the next state transition. In the formulation of PHMM, we used common pair of H-state and O-state to determine both of these phenomena. In the formulation of GPHMM proposed here, we use common H-state but different O-states for the current observation and for the next state transition separately. This slight modification brought the big flexibility in the modeling of phenomena. Experimental results showed the effectiveness of GPHMM (without delta parameters): it reduced the word error by 17% compared to triphone HMM (with delta parameters), respectively.
منابع مشابه
Stabilization of Jump Linear Systems with Partial Observation of Markov Mode
This paper deals with the state feedback stabilization of Markov jump linear systems. Feedback synthesis procedure proposed in this paper is Markov mode independent (or partly dependent), which makes the method superior to many other works in that it could handle the situation of partial Markov mode observation. A numerical example is given the illustrate the result.
متن کاملUtilizing Generalized Learning Automata for Finding Optimal Policies in MMDPs
Multi agent Markov decision processes (MMDPs), as the generalization of Markov decision processes to the multi agent case, have long been used for modeling multi agent system and are used as a suitable framework for Multi agent Reinforcement Learning. In this paper, a generalized learning automata based algorithm for finding optimal policies in MMDP is proposed. In the proposed algorithm, MMDP ...
متن کاملON THE GENERALIZATION OF N-PLE MARKOV PROCESSES
The notion of N-ple Markov process is defined in a quite general framework and it is shown that N-ple Markov processes-arel inear combinationso f some martingales
متن کاملInfinite-horizon Linear Optimal Control of Markov Jump Systems without Mode Observation via State Feedback
In this paper, we consider stochastic optimal control of Markov Jump Linear Systems with state feedback but without observation of the jumping parameter. The proposed control law is assumed to be linear with constant gains that can be obtained from the necessary optimality conditions using an iterative algorithm. The proposed approach is demonstrated in a numerical example.
متن کاملState-feedback control of Markov jump linear systems with hidden-Markov mode observation
In this paper, we study state-feedback control of Markov jump linear systems with partial information. In particular, we assume that the controller can only access the mode signals according to a hidden-Markov observation process. Our formulation generalizes various relevant cases previously studied in the literature on Markov jump linear systems, such as the cases with perfect information, no ...
متن کامل